JUL-20-2004 09:47 FROM : ROBERT M. MCDERMOTT 2152437525 TO:USPTO P. 2'10 

Appl. No. 09/408,943 Page 2 of 1 0 

Amendment and/or Response 

Reply 10 Office action of 1 6 June 2004 

Amendments to the Claims : 

A listing of the entire set of pending claims (including amendments to the claims, 
if any) is submitted herewith per 37 CFR 1.121, This listing of claims will replace all 
prior versions, and listings, of claims in the application. 

Listing of Claims: 

1 . (Previously presented) A method for processing video, the method comprising: 

determining an association between a first video segment including a particular 
feature and at least one additional information source also including that feature; and 

utilizing the association to display information from the additional information 
source based at least in part on a selection by a user of the feature in the first video 
segment while the video segment is displayed to the user. 

2. (Previously presented) The method of claim 1 wherein 

determining the association further includes 

retrieving the association from a memory. 

3. (Previously presented) The method of claim 1 wherein 

determining the association further includes 

determining the association from information in a portion of the video 

segment. 

4. (Original) The method of claim 1 wherein 

the additional information source comprises 

an additional video segment also including the feature. 

5. (Previously presented) The method of claim 4 wherein 

utilizing the association includes 

switching from display of the first video segment to display of the 
additional video segment also including the feature. 
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6. (Previously presented) The method of claim 4 wherein 

utilizing the association includes 

displaying the additional video segment at least in part in a separate 
portion of a display which also includes at least a portion of the first video segment. 

7. (Original) The method of claim 1 wherein 

the feature is a video feature extracted from at least one frame of the video 
segment. 

8. (Original) The method of claim 7 wherein 

the video feature comprises at least one of 
a frame characterization, 
a face identifi cation » 
a scene identification, 
an event identification, and 
an object identification. 

9. (Original) The method of claim 1 wherein 

the feature is an audio feature extracted from at least one frame of the video 
segment. 

1 0. (Previously presented) The method of claim 9 wherein 

utilizing the association includes 

combining an audio signal corresponding to the audio feature with an 
audio signal associated with the first video segment. 
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1 1. (Previously presented) The method of claim 9 wherein 

utilizing the association includes 

converting an audio signal corresponding to the audio feature into a 
textual format which is displayed with the first video segment. 

12. (Original) The method of claim 9 further including 

separating at least a portion of the video segment into audio categories including 
one or more of 

single-voice speech, 
multiple-voice speech, music, 
silence and 
noise 

in order to extract the audio feature therefrom. 

13. (Original) The method of claim 9 wherein 

the audio feature comprises at least one of 
a music signature extraction, 
a speaker identification, and 
a transcript extraction, 

14. (Original) The method of claim 1 wherein 

the feature is a textual feature extracted from at least one frame of the video 
segment. 

15. (Previously presented) The method of claim 14 wherein 

utilizing the association includes 

displaying information corresponding to the textual information as an 
overlay on a display of die first video segment. 
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16. (Previously presented) The method of claim 1 wherein 

determining the association further includes 

determining the association based at least in part on at least one multi- 
dimensional feature vector extracted from a portion of the video segment using a feature 
extraction technique. 

17. (Previously presented) The method of claim 1 wherein 

determining the association further includes 

determining the association based at least in part on at least one of a 
similarity measure and a clustering technique. 

1 8. (Previously presented) An apparatus for processing video, the apparatus comprising: 

a memory for storiog an association between a first video segment including a 
particular feature and at least one additional information source also including that 
feature; and 

a processor coupled to the memory and operative to utilize the association to 
direct the display of information from the additional information source based at least in 
part on a selection by a user of the feature in the first video segment while the video 
segment is displayed to the user. 

19. (Previously presented) An apparatus for processing video, the apparatus comprising; 

a processor operative 

(t) to determine an association between a first video segment including a 
particular feature and at least one additional information source also including that 
feature; and 

(ii) to utilize the association to display information from the additional 
information source based at least in part on a selection by a user of the feature in the first 
video segment while the video segment is displayed to the user. 
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20. (Previously presented) An article of manufacture comprising a machine-readable 
medium containing one or more software programs which when executed: 

determine an association between a first video segment including a particular 
feature and at least one additional information source also including that feature; and 

utilize the association to display information from the additional information 
source based at least in part on a selection by a user of the feature in the first video 
segment while the video segment is displayed to the user. 

2 L (Canceled) 

22. (Previously presented) An apparatus for processing video, the apparatus comprising: 

a processor operative 

(i) to determine from information in a portion of a first video segment an 
association between a particular feature of the first video segment and at least one 
additional information source also including that feature; and 

(ii) to utilize the association to enable display of information from the 
additional information source when the first video segment is displayed. 

23. (Previously presented) An article of manufacture comprising a machine-readable 
medium containing one or more software programs which when executed: 

determine from information in a portion of a first video segment an association 
between a particular feature of the first video segment and at least one additional 
information source also including that feature; and 

utilize the association to enable display of information from the additional 
information source when the video segment is displayed. 
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24. (Previously presented) A method for processing video, the method comprising: 

determining an association between (1) a portion of a video signal, the portion 
including a feature, and (2) at least one other information source also including the 
feature; and 

utilizing the association to enable display of information from the other 
information source based at least in part on a selection by a user of the feature in the 
portion of the video signal while the video segment is displayed to the user. 
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